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ABSTRACT 

This final report on the Pontiac Bilingual Program 
begins with a description of the program arid a discussion of the 
school-community relationship established in the program. Monolingual 
children, language- interference students, and Anglo children are 
included in the experiment. The research procedures and tests used in 
the experiment are described; the test results are presented and 
discussed. Process evaluation reports are also included; the process 
evaluation was carried out through the use of on-site visits, 
attendance at weekly staff meetings, and attendance at advisory board 
meetings. The evaluation results are summarized in the final section, 
and limitations and recommendations are presented. The appendix 
includes examples from tests used in the evaluation, (VM) 
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Description of Program 



The Pontiac Bilingual Program for the 1970-71 school year was carried 
out by three teachers, four teacher assistants, and two part time 
community liason persons. They were directly responsible to a project 
director , 

The program was conducted in an elementary school. Students not 
residing in the school attendance area were bussed to and from the 
school site. The location of the program in one school was considered by 
the staff as a definite advantage as compared with the 1969-70 program 
in which staff were itinerant. Within the elementary school there was 
one first grade classroom made up of monolingual children, language 
interference students, and Anglo children. Instruction was given in 
English and Spanish, Small group and individual instruction was con- 
ducted by a teacher and teacher assistant in a separate room. The third 
teacher spent half hour periods each day in seven first and second 
grade classrooms consisting of Anglo children. Instruction in the areas 
of Spanish language and Spanish culture was carried out in these class- 
rooms . 

The primary objectives of the program were : 

1. to improve the academic functioning of bilingual children. 

2. to increase the Spanish and English vocabulary of 

program participants, ■ 

3. to increase the Spanish vocabulary of Anglo children. 

4. to increase the knowledge of Spanish culture on the 
part of Anglo children. 

5. to involve the community in all aspects of the program 

6. to improve skills of bilingual staff. 

In addition to the work done relative to the above objectives, the 
bilingual program also carried out many activities not specific to 
the proposal. : 



In the area of community relations, the bilingual program engaged in 
^ several activities having impact on the total community. Bilingual 

staff members served as interpreters for several local agencies. Book- 
lets informing the community about local OEO programs were translated 
into Spanish, the Michigan Driver Education Test was translated, and 
a total of sixty adults participated in classes to teach English to 
Spanish speaking adults. Adult students for Oakland Community College 
were actively recruited by the bilingual staff and the project director 
gave assistance to the Student Special Services at Oakland University. 

A wide range of social services was provided by the bilingual staff. 

The community liason workers secured clothing for needy families, acted 
as interpreters to the Juvenile Court, and gave guidance in legal 
matters to non-English speaking people. 

The project director actively involved himself with the community through 
serving on the planning committee for an Oakland County Latin conference. 
He was a speaker at- the local Mexican Independence Day celebration and 
he and the staff participated in Spanish Fiesta Days held at an elem- 
entary school and a shopping center. 

The bilingual staff also served as resource persons to the local school 
district. One of the bilingual staff members assisted the high school 
counselors in their work with Spanish speaking students. Elementary 
school principals sought the assistance of the bilingual staff in regards 
to educational programs for Spanish speaking children not in the program. 
A volunteer, tutoring team was organized and trained to work with 
students on the Junior high level. The staff also assisted the district 
librarian in the selection of children’s books. The bilingual staf^f- 
also served on curriculum committees and two bilingual staff members 

ERiC v '>V' v!.;-' v 



served on the local Title I advisory board. The project director gave 
t assistance to the short term Teacher Training Program and the Career 
Opportunities Program in the areas of recruitment and training of 
interns of the program. 

The project director gave presentations of the bilingual program to 

i 

PTA’Sj served as a participant in the Iowa Bilingual Conference and is 
currently involved with Michigan State University in the planning of 
an Indian- Chicano Conference. 

The above list of activities indicates that in addition to the direct 

t 

effort on program participants, the program also has a significant 
impact on the school district and community. 
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Research Procedures 



Collection of Data 

Data were collected on a pre-post basis in September of 1970 and in 
May of 1971. The testing was done by the bilingual staff and each 
child was .tested on an individual basis. The control group was tested 
in the same manner. The selection of a control group was not accomplish- 
ed through random sampling procedures. Principals were asked to submit 
Spanish surnamed children deemed by teachers to have learning problems on a 
language interference basis. It was not possible to employ any match- 

4 

ing procedure and there was not equal representation in terms of grade 
levels. Such a control group places severe limitations on any inter- 
pretation of the resultant comparisons but the presence of a control 
group even with the above limitations is considered preferable to no 
control group. 

The experimental group consists of all children enrolled in the bilingual 
program. The seperation of the groups into monolingual or language 
interference was done by the bilingual staff on the basis of their 
knowledge of the children. 

Measures 

1) Wide Range Achievement Test: Children in both experimental and 

control group were given the Wide Range Achievement Test. 

The Wide Range Achievement Test (WRAT) was developed as a measure of 
reading, spelling, and arithmetic achievement. (Jastek, 19653 Split- 
half correlation coefficients range from .94 to .98 for all three sub- 
tests across the age range of elementary school children. Validity 
•of the WRAT was established through comparisons with other achievement 




tests and also through use of criteria of internal consistency. The 
validity coefficients computed from both procedures are of sufficient 
magnitude to attest to the validity of the instrument as a measure of 
school achievement . 

The complete WRAT was given to the bilingual students in the program; 
the spelling subtest was not given to students in the control group 
because of time limitations. 

2) Word Recognition Test: The Word Recognition Test consists of 

words drawn from the Ginn. Basal Reading Series. The student is asked to 
pronounce words from three levels of the test. One point for each word 
is earned by the student. No reliability or validity information is 
available at this time from the Ginn Company. 

The Word Recognition Test was given to all students enrolled in the 
bilingual program. 

3) FLICS Test: The Foreign Language Innovative Curricula Studies test 

is based on the Dade County Test of Language Development. The purpose 
of. the test is to assess the students' ability to produce standard 
grammatical and phonological features when he speaks. 

lest stimuli consist of pictures and the child responds orally to a set 
of questions . The test was administered to both the monolingual and 
language interference groups. 

4) Alphabet Test : The Alphabet test: was devised on the local level and 

consists of forty two letters in both upper and lower case. The test 
was given to the monolingual, and language interference groups on a pre- 
post basis. , ' ■ ■ : • 
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5) Cursive Recognition Test; The Cursive Recognition Test also 
measures the chi ids 1 ability to recognize letters of the alphabet* 
letters are written in cursive form, 

6) Number Recognition Test: This test was also devised on the local 

level. The child is asked to name numbers presented to him in written 
form. The test consists of sixteen numbers and there are also five 
drawings* The child is asked to number the set of objects in each 
drawing. 

73 Color Recognition Test: The Color Recognition test was given to 

kindergarden and first grade children enrolled in the bilingual program. 
Seven color lines were given to the students and they were asked to 
name the colors by responding with the English and Spanish names. 

8) Kindergarden Writing Samples : All kindergarden students in the 

program are considered monolingual. The students were asked to print 
their names. The child was given one point if any letters which could 
be recognized were printed. Two points were given if the complete first 
name was printed by the child, 

9) PPVT - English and Spanish Editions: The Peabody Picture Vocabulary 

Test was devised by Dunn as a measure of intelligence. (Dunn, 1965) 

For this evaluation it was used as a measure of vocabulary development. 

- ' ’ ’ - ’ i . • ’ - 

The test consists of pictures and. the student is a shed to point to the 
picture which describes a stimulus word. Both Spanish and English 
stimulus words were given to the control group and the monolingual and 
language interference students in the program. 




Reliability coefficients for the Peabody range from .73 to .84 for 
lower elementary school children. Validity was established through 
determination of the correlation between Peabody scores and Wechsler 
and Binet Intelligence Tests scores, Peabody scores were also corr- 
elated with measures of achievement. Numerous studies indicate sat- 
isfactory validity as established through the above procedures. 

Copies of all the above mentioned tests are included in the appendix. 
In addition to these tests, some rating scales were developed for use 
in the process evaluation. These forms are also included in the 
appendix. 






8 





Resul ts 



The primary objective of the bilingual program is to improve the 
academic achievement of students considered to have difficulty in 
learning due to language problems, -The first set of objectives in 
the evaluation design is concerned with the improvement of academic 
achievement among the program participants. 

Table I below' shows the pre test means and standard deviations of the 
various achievement, tests given the monolingual and language interference 
students . * 

Table I 

Pre Test Means and 
Standard Deviation 
Monolinguals and Language 
Interference Students 



Achievement 

Tests 




Monol in 


guals 




Language 


Interference 


WRAT 


N 


Mean 


SD 


N 


Mean 


SD 


Reading 


37 


8 .76 


13.59 


13 


37 .77 


16 . 14 


Spelling 


37 


13,38 


6,52 


13 


27.15 


7.06 


Arithmetic 


37 


10.57 


8.47 


13 


24.85 


4.18 


Word Recognition 


19 


9.42 


22 .60 


12 


25.33 


36.66 


FLICS Test 


18 


9.11 


10.97 


17 


20,71 


8.05 


Alphabet Test 


34 


11.12 


14.4 7 


12 


26.17 


18,77 


PPVT Spanish Test 


32 


37.84 


13.26 


19 


42.90 


9.66 


Cursive Recognition 


5 


15.40 


13.63 


11 


29.00 


12.98 . ' ; 


Number Recognition 


32 


13.28 


10 . 75 


15 


2 2.07 


6. 10 


PPVT English 


31 


24 .74 


17.27 


18 


50.94 


:.; f 8. 82 ' ;J| 


Color Recognition Test 


26 










' ... 5 ; ' ^ i; 


English 
FRIC Spanish 




4 . 54 • 
1 .58 


3.91 
2 .37 









Table II gives the post test means and standard deviations for the 
two groups, 



Table II 



Achievement 

Test 



Post Test Means and 
Standard Deviation 
Monolinguals and Language 
Interference Students 



Monolinguals 



Language Interferenc 



WRAT 


N 


Mean 


SD 


N 


Mean 


SD 


Reading 


3 7 


23.68 


16.94 


13 


48.62 


22.37 


. Spelling 


37 


22.46 


6.38 


13 


30.92 


8.98 


Arithmetic 


37 


19. 32 


6.31 


13 


27,39 


6.08 


Word Recognition 


19 


43.11 


55,95 


12 


54.93 


57.93 


FLICS Test 


18 


17.22 


6.25 


17 


31.18 


5.40 


Alphabet Test 


34 


23.47 


14.70 


12 


37.25 


13.35 


PPVT Spanish Test 


32 


44.16 


16.16 


19 


58.26 


13,11 


Cursive Recognition 


5 


35.00 


6.4 0 


11 


36.36 


8.48 


Number Recognition 


32 


21.13 


9.92 


15 


24.33 


2.58 


PPVT English Test 


31 


42.81 


14.44 


18 


60.33 


12.81 


Color Re c og nit ion 


26 






. ' ..... 






'•''tv. English 




9. 35 


1.38 








Spanish 


■ - 


7.42 


2.40 




..... 





^ ^ points out the mean gains made by the two groups and the 
' / It® f I an t t tests used to compare the pre and post tes t means 
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Table III 





Gain 


Scores and t tost 






Mono lingua Is 


(M) and 


Language 


Interference 


Groups 


CLX) 


Achievement 






: " 






Test 

WRAT 


Pre Test 
Mean 


Post Test 
Mean 


Mean 

Gain 


t 


Reading 


M 


S. 76 


23.68 


14.92 


7.85 ** 




L, I . 


37.17 


48.62 


10.85 


2.83 * 


Spelling 


M 


15.38 


22.46 


7.08 


7,42 ** 




L. I , 


27.15 


30.92 


3.73 


2.84 * 


Arithmetic 


M 


10.57 


19.32 


8,75 


11.44 ** 




L, I. 


24.85 


27.39 


2,54 


1.52 ns 


Word Recognition 


M 


9.42 


43.11 


33.69 


2.44 * 




L. I . 


2 5.33 


54.83 


29.50 


2.66 * 


FLICS Test 


M 


9.11 


17.22 


8.11 


3.57 ** 




L.I, 


20.71 


31.18 


10.47 


9.11 ** 


Alphabet Test 


M 


11.12 


23.57 


12.35 


4.05 ** 




L.I. 


26.17 


37,25 


11.08 


1.30 ns 


FPVT Spanish 


M 


37.84 


44.16 


6.32 


3.27 ** 




L. I , 


42.90 


58.26 


15.36 


6.61 ** 


Cursive Recognition 


M 


15.40 


35.00 


19.60 


3.07 * 




L.I. 


29.00 


36.36 


7.36 


2.79 * 


Numb cr Recognition 


M 


13.28 


21.13 


7.85 


2.93 




L.I. 


22.0 7 


24.33 


2,26 


1,26 ns 


PPVT English 


M 


24.74 


42,81 


18.07 


9 , 20 ** 


Color Recognition 


L.I. 


50.94 


60.33 


9.39 


2.76 * 


English 


M 


4.54; 


9.35 


4.81 


6.99 ** 


Spanish. 


M 


1 . 58 


7.42 


5.86 


11.80** 




* ^Significant . OS level 
** ^Significant . 01 level 
ns -non significant 
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Inspection of Table III indicates that in the majority of comparisons, 
significant gains are shown by the program participants. In regards to 
achievement as measured by the Wide Range Achievement Test, the gains 
demonstrated by the monolingual group are larger than those demonstrated 
by the language Interference group. In fact the language interference 

group showed no appreciable gain in their arithmetic skills during the 

/ 

school year. 

The language interference group also showed no significant gain in 
their ability to name letters of the alphabet and in recognition of 
numbers. Further comments regarding the functioning of the language 
Interference group can be made on the basis of comparisons with a control 
group. The language interference group and control group were compared 
in terms of reading, arithmetic achievement and also' on measures of 
Spanish and English vocabulary development. Table IV gives the pre test 
means and standard deviations for the control group on the above measures 
Table V gives the post test data for the control group. The reader is 
referred to Table I and II for the data regarding the language interfer- 
ence group. 





Table 


IV 




Pre Test Means, 


Standard 


Deviation 


Control Group 


Wide Range Achievement Test 


N 


Mean 


Standard Deviation 


Reading 


26 


27.26 


18.37 


Arithmetic 


26 


16.62 


7.90 


PPVT Spanish 


26 


30.73 


12.88 


PPVT English 


26 


56.39 


14.09 



Table V 

Post Test Means, Standard Deviations Control Group 



Wide Range Achievement Test 


N 


Mean 


Standard Deviation 


Reading 


26 


40.00 


16.76 


FR?f h c eti? , 
Li\R> ^Spanish 


n 


6 M9 


6.28 

14.59 


WW 5 "Engl' ish 


26 


64,46 


- • 9.34 



The mean gain scores of the control group are compared with the 
gain scores of the language interference group in Table VI. 

Table VI 



Mean Gain Scores -Language Interference end Control Groups 



Test 


N 


Language 

Interference 


. N 


Control 

Groups 


t 


WRAT 










Reading 


13 


16.85 


26 


12,54 


.3540 ns 


Arithmetic 


13 


2.54 


26 


8.27 


3,05 ** 


Spanish Vocabulary 


18 


15.36 


26 


2.96 


2.96 ** 


English Vocabulary 


18 


9.39 


26 


8,08 


.28 ns 



** - Significant .01 Level 
ns - Non Significant 



Inspection of Table VI points out that when a control group is used 
for comparison, the significance of the gain scores shown by the 
language interference group are not as striking as when only the pre- 
post gain scores of the group are considered by themselves. 

In the reading area for example the language interference students in 
the bilingual program do not show a gain greater than language Interfer- 
ence students not in the program. In the arithmetic area, greater gains 
are shown by the control group. The Spanish vocabulary of the language 
interference students in the program increased markedly when comparisons 
with a control group are made. There was no difference between the tw r o 
when their English vocabulary development was examined. 

The above conclusions must be imterpreted in a cautious manner because 
of the lack of proper selection of a control group. The method of 
selection of the control group was not on a purely random basis and more 
■y^ortant , there was no attempt to match experimental and control groups 



on significant variables. The evidence here that language interference 
students enrolled in' the bilingual program do not show any more gain 
than language interference students not enrolled in the program is only 
suggestive. The trend is such, however, that any future evaluation of th< 
bilingual program must include data 'from a control group matched with 
the experimental group in terms of age, IQ, sex, and grade level. 

From the evidence which is available it appears that the bilingual 
program is most effective for the monolingual students. A review of 
Table III points out that on the ten achievement measures, the monolin- 
gual group showed higher gains than the language interference students 
on eight of the measures. The language interference group showed higher 
gain on the FLICS test and the PPVT- Spanish version. While it appears 
that the program is more effective for mono! inguals than for language 
interference students, meaningful generalizations are difficult to 
make in the light of the present data on a small, poorly matched control 
group, and the absence of any data on a monolingual control group. 

Two objectives of the program relate to Anglo children. The objectives 
were to increase knowledge of Spanish culture and to develop 
Spanish as a second language. The results of the measures to quantify 
these objectives are given in Tables VII , yj i i , and IX. 

Table VI I presents the pre test data means and standard deviations. 

Table VI_II gives the post test means and standard deviations while 
Table IX shows the mean gain scores and the resultant t scores. 
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Table VII 



Pre Test Means, 
Standard Deviations 
Anglo Group 





Tests 


N 


Mean 


Standard Deviation 


Spanish 


Vocabulary Test 


59 


4.80 


3.83 


Spanish 


Culture Test 

i 


59 


2.86 


S .11 



Table VIII 

, Post Test Means 
Standard Deviations 
Anglo Group 





Tests 


N 


Mean 


Standard Deviation 


Spanish 


Vocabulary Test 


59 


20.22 


11,83 


Spanish 


Culture Test 


59 


4.97 


2 .S3 



Table IX 

Mean Gain Scores 
t test Anglo Group 





Tests 




N 


Pre Test 
Mean 


Post Test 
Mean 


Mean 

Gain 


t 


Spanish 


Vocabulary 


Test 59 


4.80 


20.22 


15.42 


11,54 


Spanish 


Culture Test 


59 

A* 


2.86 

significant , 


4 9 7 
01 level 


2.11 


3,16 


Significant gains were 


made by 


the Anglo children in the 


area of 




Spanish 


Vocabulary 


and 


Spanish 


Culture . The 


program then 


achieved 


Its 



two objectives relative to the Anglo group , 



Process Evaluation 



/ ' 

( 

A process evaluation o£ the bilingual program was carried out through 
use of on-site observational visits, attendance at weekly staff meet- 
ings, and attendance at advisory board meetings. The process evaluation 
reports will now be presented. Project records were also used as well 
as information gained from periodic contacts i\fith the bilingual staff 
and program director. 
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Bilingual Program 
Process Evaluation 
Report #1 



September 29, 1970 



Performance Objective 

To improve academic achievement of monolingual and language inter- 
ference students. 

One group of monolingual and language interference students were 

observed working with a teacher assigned to the bilingual program. 

\ 

An aide also took part in the instructional process. Instruction was 
geared to having the students learn English words and common greetings. 
The teacher would say the word or phrase with each child in turn 
repeating the phrase or word. If correct the student collected a 
colored piece of paper. This made learning a "game" to the students. 

High interest, and active participation on the part of students were 
evidenced. 

Performance Objective 

To increase the Spanish vocabulary of Anglo children. 

Two titfenty minute class periods were observed. The bilingual teacher 
and aide instructed the children. Specific content were Spanish 
numbers one to five, and the phrase - "what is your name - my name is," 
Children were active and involved, generally showing growth in ability 
to repeat numbers and phrases. 

Teachers made good use of reinforcement, procedures. It appeared in one 
class that the aide was not given a specific responsibility. In the 
second classroom she took an active part in the instructional process , 



Process Evaluation Report # 2 
Bilingual Program October 1970 

An observation of the activities in the first grade at Emerson 
school. The class contains monolingual , language interference 
students, and angle children. 

In contrast to the previous observation, the teacher now has 
adequate instructional materials. Responses and enthusiasm of 
students were noticeable. 

Community Aides were hired and trained to give the Peabody Test 
and Spanish Vocabulary Test to a control group. Testing procedures 
were observed on October 26, 27 and 28th. Testing conditions and 
procedures were deemed sufficient after some minor adjustments. 

A conference with txvo teachers regarding testing procedures for 
the Anglos in the program. It was decided that two additional 
testswere needed. These tests were completed November Sth and 
procedures for administration have been initiated. 



The time allotment of 20 minutes appears too short for meaningful 
involvement on the part of all children. 



Performance Objective 

To improve academic performance of, language interference and monolingual 
students in a regular classroom: instruction carried out by a bilingual 

teacher .j 

i 

I 

One first grade classroom was observed, A reading lesson was presented. 
Teacher gave directions in English and Spanish, Spanish background 
children were able to participate in the ques tion- answer period with 
the teacher. * 

The teacher was obviously hampered by the lack of materials - not 
enough textbooks. She had to use an overhead projector: the projected 

image was not clear with the result that attention of children was 
difficult to focus. 

The aide worked with another group on another task. It appears that 
good use of the aide's time is being made. The physical set up of 
the classroom places limits , however, on the maximum effectiveness of 
the aide. 




i 





Process Evaluation Report #3 



Bilingual Education Program: December 17, 1970 

Performance Objective: 

Bilingual aides will attend scheduled classes at Oakland University 
College and will receive grades of G or better. 

Procedures for measuring attainment of objective: 

1, Conference with Director-OCC program 

2, Interviews with bilingual aides 

3, Examination of school records 

A conference was held with the Director of the educational program in 
which the 6 bilingual aides are enrolled. The following information 
was derived. 

The six bilingual aides have completed satisfactorily the courses 
offered in the first semester. They accum.1 a ted 10 hours of college 
credit. The completed courses are: 

1, Foundational studies of 

Natural and Life Sciences - Credit Hours 4 

2, English 151 or 152 Credit Hours 3 

3, Sociology 251 or 252 Credit Hours _3 

10 hours 

Aides attend classes for 3-one half days a week. Records indicate 
that attendance has been good (minimum of 3 absences).’ Some of the 
aides are in the advanced sequence of the course, 



n» 



Interviews with the aide.-, indicated that basic skill development has 



been a major part of the foundational studies course and English 
course. The sociology course has involved the aides in articles and 
discussions pretaining to contemporary social problems. Their reaction 
to the educational program is highly positive. 

/ 




Bilingual Program 
Process Evaluation Report #4 
December- January -February 

Program Objectives Monitored: 

1. To increase skills of teachers and aides. 

2 . To provide orientation for bilingual staff in terms of 
job descriptions and detail a time and space for carry- 
ing our staff responsibilities. 

Five staff meetings we re attended by the evaluator for the purpose of 
monitoring. A secondary objective for staff meeting attendance was to 
involve staff individuals in the design of some evaluation instruments. 

Two of the meetings attended dealt with the planning of the 11,-72 
bilingual program to be housed in the Human Resources Center (HRC). 

Mr. Thor Peterson, director of the Human Resources Center was present 
at one meeting to explain the organizational structure of the HRC. 

The staff readily reacted to the proposed plan and provided valuable 
input in terms of the manner in which the bilingual program could fit 
into the proposed plan. The staff is also in the process of identifying 
objectives for next years * program. 

The third and fourth meetings focused on the establishment of a rating 

scale to determine effectiveness of bilingual staff. A tentative rating ■ 

form was established. The rating form will be used the remaining five 
months of the program. 

A fifth staff meeting dealt with curriculum materials . One of the staff 
members presented the Miami Linguistic Series and suggested possible use 
of the materials- in the program. A report was also made relative to the 
it of the bilingual programs operative in Miami Beach, Florida. 




Impressions and Jiggesti ns - Bilingual Staff Meetings. 

f: 

E . 

The staff meetings monitored over a three month period give ample evidence 
that the bilingual staff are provided sufficient orientation. Moreover, 
there appears to be a good effort on the part of the project director to 
involve the staff in program plans and to keep them abreast of developments 

i 

Skill improvement as noted in that active efforts are made to present to 
staff new instructional procedures and materials. Use of audio-visual 
materials is encouraged by the project director and the staff express the 
view that they are given 'the opportunity to try different approaches. 

For the most part there is active participation and involvement during 
staff meetings. However, there is a tendency for a few of the staff to 
remain passive in the meetings -and not provide input. It is suggested 
that more active effort be made by the project director to involve these 
individuals . 

A written, time scheduled agenda for staff meetings would be helpful to 
keep the staff tasks orientated. Minutes of staff meetings would also 
be helpful in that basic decisions of the group would be in written form 
hence less subject to possible, future misinterpretations . 
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Process Evaluation Report #5 
Bilingual Program 

February 25, 1971 

j ' 

Performance Objective; The project director will organize and 
maintain a Community Advisory Board. 

The first formal meeting of the Community Advisory Board was 
attended at 9 Victory Court, The purpose of the meeting was to 
inform the community of present planning concerning the implementation 
of the Bilingual program in the Human Resources Center. Mr. Petersen, 
director of HRC described the physical structure of the HRC and the 
planned instructional program. 

There was good interaction and participation among the committee 
members. The meeting was well structured and organized and the 
committee left with some definite ideas about their role. 

Suggestions : 

1, Bilingual staff members or representative should be 
present at advisory committee meetings. 

2. Written comments of the meetings should be published 
within a newsletter format or letters to parents of 
children in the program, 

5, Some thought might be given to having a high school 
student, Mexican American serve on the committee. 



Process Evaluation £6 



March 18, 1971 



Performance Objective: 

To increase Spanish and English 
Vocabulary of program participants. 

To increase knowledge of Spanish 

Culture. 

Observation: - Classroom 

Teacher and teacher assistant used arithmetic games. Students 
were very attentive and enthusiastic. Teacher makes very good 
linage 0 f positive reinforcement techniques. Teacher assistant 
gave assistance at table where students were involved in another 
activity (workbooks) , Teacher assistant would be more helpful 
if she would increase movement around the room. 

Second activity was listening to Spanish music and engaging in 
dance patterns led by the teacher. Activity was of value in 
getting across ideas of Spanish culture and heritage. However, 
the non-participants were not encouraged to join the group 
dance. The period also could have been more structured in 
order to impart significant information about Spanish dance 
and music. 



Process Evaluation Report #7 



April 20, 1971 

Performance Objective: Improve Reading Achievement 

Observation: Small Group Instruction 

Teacher and teacher ass is tants were working with three language inter- 
ference students in the reading area. There was good use of material 
tailored to needs of students. Teacher assistants followed up group 
instruction with individual help. 

The approach used by the teacher is an individualized one. It is 
apparent that she knows the students' level of functioning. Teaching 

is carried on m a non-critical supportive manner. Excellent rapport 
with children is evident. 

















Process Evaluation Report #8 



May 1971 

Pe rformance Objective: To increase Spanish Vocabulary 

A visitor,^ Spanish speaking, read a story in Spanish to the bilingual 
class. Few of the students showed much interest in the particular 
stoiy. The group was too large to allow for maximum participation on 
the part of the students. Timing also was off in that the story tell- 
ing took place late in the day when concentration skills of the student 
were at a low level. 








Process Evaluation Report # 9 

May 1971 * 

Objective: Development, Adaptation of Curriculum Materials 

Project records indicate the following activities regarding curriculum 
development and adaptation, 

1. A staff meeting to introduce the Miami Linguistic Series 
was held, 

2. EFI flashcards were purchased and used by the staff. 

3. A multi media readiness kit was purchased and put into 
instructional use, 

4. The Holt-Rinehart M I Wonder Why” series were acquired and used, 

5. Perceptual Learning Puzzels were purchased and used by bilingual 
staff with program participants, 

A revised curriculum guide was not formulated hence the objective was 
not met. However, the list of activities does indicate that the staff 
have been actively involved in the development, acquis i t ion , and use of 
new curriculum materials. 
















Process Evaluation Report #10 



June 1971 

Program Objective: Involvement of Parents in the Program 

Project records indicate that there was an increase in the number of 
parents attending parent -teacher conferences, in comparison to last 

years attendance records. The objective of a 70S criterion, however, 
was not met. 

There were five Advisory Board meetings held throughout the year. An 
average of 12 persons attended the meetings but there was considerable 
variability in attendance. 

While the specific criteria for the parent involvement objective were 
not met, there is ample evidence that the program has had an effect on 
the community if the list of community activities is considered. 
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Process Evaluation Report #11 



June 1971 

Program Objective: To Develop Skills of Bilingual Staff 

The bilingual staff during the 1970-71 school year attended the follow- 
ing inservace programs. 

i 

I 

1. Saginaw Conference -• Bilingual Education 

2. Oral Language Workshop 2 weeks. Summer 1970 

3. Oral Language Workshop 2 at Frost School 

4. Compensatory Education Conference Grand Rapids, May 1971 

5. On-Site visitation -• Dade County Program, February 1971 

6. Bilingual staff have attended six Saturday pre service 
workshops pretaining to the operation of the Human Resources 
Center 

The pre-post achievement tests related to the summer oral 
language workshops show that bilingual staff attending the workshops 
significantly increased their knowledge of oral language concepts. Ther 
were no other evaluations of inservice programs. 

No attempt was made to examine the Pontiac Teacher Effectiveness Forms 
and compare them with previous ratings hence no statement can be made 
relative to this segment of the objective of increasing skills. Satis- 
factory performance of the staff is indicated, however, by the fact 
that all staff members have been requested to participate in the 1971-72 
program. 





Process Evaluation Report #12 



June 1971 

Program Objective: To Increase Educational Level of 

Bilingual Aides 

Records from Oakland Community College indicate that five of the six 
bilingual aides earned Associates Degrees this past school year. The 

sixth aide will have completed the number of required hours in the 
fall term. 



Pour of the five graduates of Oakland Community College were graduated 
with honors. 

The objective of increasing the educational level of bilingual aides 
was satisfactorily met. 
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Process Evaluation Report #13 



July 1971' 



Program Objective: Project Management Evaluation 

The management of the bilingual program was evaluated thro 
management checklist which indicates if the program direct 
functions listed in the job description of program manager 



ugh use of a 
or carries out 
- bilingual 



program. 



The following checklist of activities indicates that the project 
director fulfilled his major responsibilities as project director 























1 . 



Management Checklist 



Bilingual Program 



Function 

Provides Orientation for Staff 



■ Evidence 

Held weekly staff meetings 
Criteria of written job des- 
criptions for each staff member 
not met. 



2, Explains program to school staff 
where program is located. 



Project director met informally 
with teaching staff and school 
principal. 



3, Works with school principals in 
assignment of children, 

4, Organizes and maintains Community 
Advisory Board, 

5, Maintains liason with USOE, LEA, 

6, Reviews Evaluation Design 

7 , Arrange for an independent audit , 



Consulted with school principals 
relative to placement. 

Five Advisory Board meetings 
took place . 

Submitted written reports to USOE, 
Had telephone conversations with 
program director. Conferences 
with LEA administrators. 



Numerous meetings with internal 
evaluator . 

Written contract with external 
auditor , 



8. Provides supervision for staff 



9 , Periodically observe teachers 
and aides . 

10. Makes changes as needed 



11* Aides in the development of 
curriculum materials. 




Held group and individual confer- 
ences . 



Frequent visits to classrooms , 
Made ratings of teachers. 



Submitted addendum to original 
proposal . Involved in planning o 
1971-72 program in new location. 
Submitted revised daily schedule. 



- isf 



fay# 



Ordered [new materials . At staff 
meetings , showed staff new 
materials . fa'C 



• fa- fafa'fa 



: ■ ■ >■■ i 
■fafafa 

: W - 
= s ■ _ 



■. fa ? v-.#..: 



■ v: , 1 

: ■' 4 . ~~tm 



'■ ' ■ ~r . fait 



Summary . 

Product Evaluation 
Academic Achievement' Objectives 

Data analysis comparing pre and post achievement tests indicated that 
significant gains were made by the monolingual and language interference 
groups in the following areas: 

1 , Reading 
2 . Spelling 

3. Arithmetic (Monolingual group only) 

4. Word Recognition 

5. English Gramme r 

6. Alphabet Recognition 

7. Spanish Vocabulary 

8. English Vocabulary 

9. Number Recognition (Monolingual group only) 
10, Color Recognition - English, Spanish 

ihe gains made by the monolingual group were generally larger than the 
gains shown by the language interference group, 

Wien the achievement gains shown by the language interference group 
were compared with a control group it was found that the students, in 
the bilingual program showed a significantly greater gain in development 
of Spanish vocabulary. They did not differ from the control group on 
the measure of reading achievement and the control group demonstrated a 
significantly greater gain on the test measuring arithmetic computation 
skills . 

The Anglo students participating in the program showed stalls t i cal ly 
significant gains on the measures of 'Spanish Vocabulary development and 
knowledge of Spanish culture . 
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Product Evaluation Limitation 



ihe conclusions made based upon this evaluation report must be con- 
sidered in view o£ limitations inherent in the research design and 
implementation. The following limitations should be borne in mind. 

1* There are no clear, delineated definitions of what constitutes 
mono 1 ingua 1 i sm or language interference. 

2. Reliability and validity information on many of the tests 
is not available. 

3. The size of the sample made it impractical to examine the 
data in regards to age, sex, or grade level categories. 

4. No control group data to compare with the monolingual group 
data are available. 

5. The control group for the language interference group was not 
matched on relevant variables . 

Conclusion - Product Evaluation 

The bilingual program has had a significant effect on the achievement 
the program participants. The program has a more significant effect 
on reading achievement than it does on arithmetic achievement and 
monolingual students profit considerably more than do language inter- 
ference students. Apparently the program has little effect on the 
academic achievement of language interference students. 

Anglo students profited from the program in terms of learning about 
Spanish culture and in increasing their ability to us Spanish words. 



Process Evaluation 

The process evaluation reports indicate that the bilingual staff operated 



in an effective manner interms of 
and also in working with teachers 
school district personnel. 



O 




working with 
in the host s 




the program participants 
chool as well as the 



The program while judged to have a significant impact on the community 
at large did not achieve its objective in increasing parental 'involve- 
ment. The program also failed to reach its objective in regards to 
development of a curriculum guide specific to program participants. 

The bilingual staff upgraded their skills as evidenced by attendance 
at numerous inservice training sessions. Quantification of skill 

0 P m ®n.t , however, was not carried out hence the above conclusion is 
a subjective one. The educational level of the aides was raised as 
evidenced by their earning of Associates Degrees from Oakland Community 
College . 

The program manager carried out the functions defined by his job des- 
cription. No attempt was made to assess the quality of specific 
activities but his retention as project director for the 1971-72 program 
attests to a satisfactory rating on the part of school district super- 
visory personnel. • 



Recommendations 

In regards to future evaluation, it is necessary that satisfactory 
control groups be established. Contacts have been made itfith other 
school districts in an attempt to obtain control group data. There is 
also a need to develop or acquire adequate instruments. 

I 

The program needs to put more emphasis on the arithmetic area. The data 
also suggest that innovative strategies for the teaching of reading 
need to be developed especially for the language interference group. 

Considerably more work needs to be done in the area of parental involve - 




3Q 



ment . Apropos to this, is the need for time and personnel to actively 
search out and encourage activities to increase the parental involve- 
ment componant. Additional resources are also needed if bilingual 

staff are expected to develop, experiment with, and field test curriculum 
materials . 
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rp 



Grade 



Examiner 



. ffeaOher 



CcsH wr- ' ' 



' ?( Name 2 Spanish songs. 

£. Poncho lives in a very dry part of Mexico. What kind of house does he live ini 

* a s « 

r * i 

* 3, Maria lives in a wet "part of Mexico. What kind of house does she live in? 

X • ■ •• / • • .* ; ' r ‘ ’ \ 

l|. "What does the Mexican fanner get from maguey .plant? 

5, What is one of the valuable metals that comes from Mexico? 

6 . Does it snow a lot in Mexico? * 



7. What kinds of Indians lived in Mexico at one time? » 

8, What is the national game of Mexico? • 

/ »*What would you do with a tortilla? 

* 

* • * a ! 

10. Poncho has a pinata, what does he do with it? 

11. Maria has a new dress to go to a posada, Wt Lat is a posada? 

12. What language do most people speak in Puerto Rico? . 

* " , 

fc** . *' • 

13. Ana lives in Puerto Rico. She asks her mother to cook a favorite family food. 
What do you think the mother cooked? 

llj . Where do you think this is? (Show Picture) 

15. Where do you think this is? (Show Picture) 
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Spanish Vocabulary 
TEST 



;i - 


amigo 






2 - 


este 






3 - 


uno 






1 


do 8 






5 - 


tres 


_ 




6 - 


cuatro 






7 - 


eineo 






8 - 


libro 




$ 


9 - 


lapiz 






10 - 


cuaderno 




. 1 


11 - 


nines 






12 - 


senor 






a 


s ©flora 


« “Ai 




iij - 


senorita 






15 - 


£Que? 






16 - 


si 






17 - 


pap el 






18 - 


TTestido 






IP- 


saco 






SO - 


pantalon 








rojo __ 






22 — 


verde 






23 - 


azul 






2k - 


amarillo 








"bianco 







26 - negro 

27 - mama 

28 - papa 



29 — hermano 

30 - hermana 

31 * padres 



32 — naranja 

* 

33 - manzana 

3I1 - fruta a 

35 * uva _ 

3 6 - jugar 

37 — cantar 



correr 

caminar 

muneca 



ko 

111 — escuela 
k2 - maestro 
t3 - grande 
1|1| — pequenq_ 
k5 - iQuien? 
k6 — globos 

hi 
U 8 
hg 

50 . - mesa 



Date 



tener 

muszea 



eaneion 
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MICHIGAN ORAL LANGUAGE PRODUCTIVE TEST - Structured Response 

Directions for Administration 

• I. OBJECTIVE : ■ :: 

-- The purpose of the test is to assess the child's ability 
to produce standard grammatical and phonological features 
when he speaks. • . 0 ■ \ 

II. METHOD •: ... •? : ••:<• s-r. L ' *• 

; r.-i . A. Standard Stimulus . The child is shown three pictures 

• ■ -which form a story. He is gi ven-ra' Stimul us (S) concerning one 

of the pictures. The Stimulus is structured so that the child 
will give a Response (R) containing a particular feature of gram- 
mar or pronunciation. 

. : The procedure for giving the Stimulus (S) and scoring the 

Response (R) is as follows: .. . w 

: r ■ 1. Gi ve Stimul us , marked S i : 

v. f ■ 2 . If Child does answer with underlined Response (R) 

— record response number . , ... . 

i' 3. Give (S) second time if child gives no answer 
the first time. .... 

4. Do not give any further help. 

5; ..If child gives an answer which is not listed in 
! 1 >. the test* or if he doesn't respond after the second 

k :.vv.t : '.'••time, mark 0 (other) . . - • 

. B. Importance of Standard Stimulus . It is important to 

' f •: ;• give the Stimulus T§1 as it is written . \ : 

. • ::: \; :For. example: (Question 5 - Stimulus) —.r 

r PAST . PARTICIPLE • I . v . • . / 

S (Point to boy) (Child's name). 

' ■ L. . r--- s' j ' Ask the boy if he 

v ■ -s '? ' <<J always goes to this 

rod zt.",r .\T ■ i ^ river to fish. 

' s' ^ is i i 1 •'* >■ i ; ,-i v * .(T Have you always... 

As may be seen* if the examiner did not include the words, 

■ • ■ Have you always , the child could say. Do you always go , 

instead of Have you always gone .' It would then become 
rdif.fi cU'l,t;to find out what word the child uses for gone 
: - without actually giving him a cue or answer, 

; ; C . Use of Tape Recorder . To help the teacher check on 

.• ;• Whether or not he has given a standard Stimulus, it is 

convenient to use a tape recorder during the testing sessions 
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Later on, when playing back the tape, the teacher may not only 
check on the standard Stimulus, but also recall various features 
from an individual child's test. The children wi 1 1 not be 
afraid of the recorder if they are al lowed to hear themselves on 
the recorder a little bit before the test. 

The tape recorder need not be used extensively to score 
the test, however. Examiners have found that on-the-spot scorn- 
ing is not only more practical but equally or more reliable for 
checking sound differences that are important in the phonologi- 
cal and grammatical features tested. . , 

GENERAL TEST CONSIDERATIONS 

_ _ A* JA me Bega The 43 items should take approximately 

15 munutes to give. 





. • Testing Room and Equipment . No extra equipment is 

n e e d ed besides the test booklet with its three pictures. You 
will need to reproduce five more response sheets, A tape recorder . 
is advisable for the first few children as a means of self- 
checks, . ; j 

• ^*'1 S^stting the Child at Ease , The teacher is at an 

advantage in the testing situation because the child already 
knows her. Working with the tape recorder may be strange for 
the child, and the test may.be different from any he has 
encountered before. However , the tape recorder wi 11 help the 
teacher get the child to name his brothers and sisters, tell 
about a pet, tell about something he did well yesterday in 
cjass-; or, if the child does not seem to be afraid, he may 
wish to tell about the things he sees in the first picture 
he l s shown . 

Sometimes the children are quite verbal, and sometimes 
they need help in this warm-up period. If the child does not 
respond to the questions above easily, it is best just to go 
right into the test. The praise given for answering will 
begin to make him feel at ease . 

^ D- - Efaise for Answering , The chi Id feels more relaxed 
-, W1 • ] try to give better answers if he is praised. Even 
if he misses gi ving the gramma t,1 cal or phono! ogi cal feature 
needed, praise may be given , However, the child is sensitive 
to false praise. It is better to give moderately positive 
comments such as, fine, or You're qiving me lots of answers 
°r .even an enthusiastic uh-Tiuh or 0. 1C. Often words 1 ike, good 
an d ve ry good , begin to sound false., Also, testers sometimes 
find themselves saying; good , when the answer is standard and 
a dull uh-huh , when the answer is non-standard. Moderately 
positive comments will guard him from this tendency. 
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IV. SPECIFIC TEST CONSIDERATIONS 

. There are many questions the teacher will have as she 

begins to test. The most common are listed below; 

1. What is the best way to give the Stimulus? 

The Stimulus must always be read word for word. Sometimes 
you will find a line of dashes drawn over to a part of the 
Stimulus. It is helpful for the child to repeat the 
Stimulus from this part through to the end. 

For example; (Question 34 - Stimulus) 

USES OF BE 

S' Let's name some things 

/r> . , . in this picture, 

(Pointing) These are dishes. 

(Point to table) These are chairs, and 

(If necessary, help - ■ 

child repeat) - - - - This ... 

If the child repeats this , it gives him a good start at 
producing the whole sentence. Otherwise, he may give 
a short answer, a table . The verb to be tested will bo 
missed. 



2, How do you get a child to repeat the last word? 

After the teacher becomes somewhat familiar with the test, she 
will be able to use eye contact to have the child repeat what 
she says. The child will become used to the teacher looking 
up from the picture and will realize he is to repeat words# 

This eye contact system has the advantage of being non-verbal, 
so the child can concentrate only on the question. Until the 
/ system is established, the teacher may need to deviate from 
/ the general instructions in the following way: 

a. Read the entir e Stimulus; 

b. Tell the ch 11 dT Sa y what I say, (child's name). 

c. Repeat just the starting word of the child's sentence. 

d. Repeat the entire Stimulus with the child's startino 
word given twice. • 

For example; Teacher; Did the father start to 

fish by himself, or did 
~ ha wait for the boy? 

He . . . 

f 

Teacher: Say what I say, (child's name). 

Teacher; Me ... 
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If necessary. 

Teacher: Did the father start to 

fish by himself, or did 
he wait for the boy? 

He 

He . . . 



3, What if a child remains silent? 

If a child remains silent on a particular question, it may 
be that he doesn't know the meaning of one of the words. 
This has been anticipated to a great extent in the test. 
Changes have been made to use simpler words, or definitions 
have been provided. In any case, it is a good policy when 
the child is silent to ask* 

Teacher: Do you know what ( ) means? 

It means (simple synonym). 

(Repeat Stimulus) 

Even if the child says he knows what a word means, it is 
good to give the synonym. 

Sometimes the child doesn't understand what the teacher is 
pointing to in the picture. However, if the teacher tries 
to give some verbal explanation, she may run the risk of 
giving the child the answer. Therefore, If the child does 
not seem to understand what the teacher is pointing to, 
the teacher may say: 

Teacher: Point to the same thing I'm pointing to. 

(Guide child's finger to same point) 

(Repeat Stimulus) 



4. What if a child generally does not give answers? , 

It is easy to assume that if a child does not give answers, 
he doesn't understand. It is just as easy to assume some 
• erroneous causes. The teacher is at a distinct advantage 
in this testing situation. If a particular child does not 
give answers, the teacher may want to re-test him after she 
has tested several other children. Quickly reviewing the 
information she has accumulated with these children, she 
may pick out the simplest questions. Starting with these, 
the child will probably begin to answer questions. 
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5. Is it necessary to test exactly five students several 
times a year? 

There is no magic about the number five. In other 
words .it is not a necessary number; it is only a 
convenient number. We would like to stress, however, 
that the value of the Structured Response test is 
it's ability to give the teacher a quick overview of 
her students* language needs. The more efficient 
the curriculum is in meeting the students' language 
needs, the more quickly the overview is likely to 
change. To ease the teacher's load, we recommend 
that she test five pupils taken at ran don every six 
weeks or so. She can easily spend fifteen minutes 
with one pupil each day for a week. 



6, What will the scoring system tell me? 

The Structured Response test has eleven grammatical 
and phonological categories. After the teacher has 
tested five pupils, for example, she need spend only 
1 5-20 minutes to arrive at the Category Percentages 
for the eleven categories. You will notice that 
the Category Sheet helps you keep record of the 
percentages for six testing dates. This record can 
show you if the curriculum's progress is meeting 
the students' language needs. 
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MI CHI GAN ORAL LANGUAGE PRODUCTIVE TEST - Structured Response 



Directio n s for Administration 
a. Give Stimulus, marked S. 



f. 



Example (Item 1 below) 

S Let's name some things, 
(child's name) . 

This is a boy. This is 
the father, and these 



b. As you read, point to Stimulus 
objects in picture. 

e.g,» Point to boy when saying 

Point to father when saying 

Point to trees when saying 

c. If child answers with an underlined 
Response, marked R, 

-Record response number on Response 
Sheet, e.g., (1) ... are trees 



This is a boy 
This is the father, 
and these . . . 



See section (R) in Item 1 below 
Recorded as: (1) 



Response number is determined only 
by under! ined portion; 
e.g. , ... trees 
e.g. , ... fs_ tadpoles 



Recorded as : 
Recorded as: 



(5) 

(5) 



e. If child doesn't answer, or doesn't use 
an underlined Response, 

-Repeat Stimulus 
-having child join in with 
you from the dashes; 
e.g., (If necessary, 

have child repeat)- ------ 



See section (S) in Item 1 below 



•This is a boy. This is 
the father, and these , , 



After second time, if child still doesn't 
answer, or doesn't use an underlined 
Response, 

-Record (0) 

-Go un to next item 



Recorded as: (0) Other 



Accept final response; 
e.g.. If child says, ... are trees 
and then says, ... is trees 



Recorded as: (5) 



Example (Item 1) 

$ Let's name some things, R (1) 

. (child's name). 

(Point to objects) (5) 

(If necessary, . (6) 

have child repeat)- - -This is a boy. (7) 

This is the father, 

(Points to trees) and these ... (0) 



are trees. 

is trees, 
be trees, 
trees, ( verb 
omi 

Other 



* • • 

■ * • 

« • i 






O 

ERIC 
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lest Items 

V. USEroTlJE 

( Are as main verb) 

5 Let's name seme things, 

(child's name). 

(Point to objects) 

(If necessary, 

help child repeat)- - - This Is a boy, 

. , / This is the father, 

(Point to trees) and these ... 



R (1) ... are trees. 



(5) ... Is trees, 

(6) ... be trees. 

(7) ... trees. 

(0) Other 


(verb omitted) 


PLURAL 

'(Regular - /z/ ending) 




S (Point to trees) 


Let’s count these, (chil 
One, two, ... 

Three what? 


r (1) Trees. 


(s_ pronounced fzf) 


(5) Trees. 

(6) TreaTlJ. 

(7) Treezez. 
(0) Other 


(s, pronounced /s/) 
i/z/ omitted) 
(non-standard plural) 








50 



Use Picture 1 



name). 
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3. DOUBLE NEGATIVE 

(Negate cl main verb plus affirmative noun determiner or noun subsititute 
doesn't have plus a_ s one , or any) 

S (Pointing) The father has a fishing pole, but 

the Boy doesn't have ... 



R (1) ... fishing pole, 

(2) ,,, one , 

(3) ... any fishing pole, 

(4) ... any . 

(5) ... no fishing pole, 

(6) , , . none , 

(0) Other 



4, USES OF HAVE 

( Have as auxl 1 1 ary ; requires following past participle, walked) 

$ (Point to boy) (Child's name) 

Ask the boy if he has walked 
along the river before. 

R 0) Have you wal ked along the river before? 

(5) Has you walked along the river before? 

(6) Has you walk( ) along the river before? 

(7) Have you walk!" ) along the river before? 

(8) Did you walk along the river before? 

(9) Di d you wal ked along the river before? 

(10) Is you walk along the river before? 

(11) Is you walked along the river before? 

(12) You walk along the river before? ( have and ,-ed omitted) 

(13) You . walked along the river before? ( have omitted) 

(0) Other 
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( 



( 



5. 



S 



R 



PA ST PARTICIPLE 

TTrregular - past participle, gone , not the same 
/o/ # i.e. , goed , nor as the past, went) 



as infinitive plus 



(Point to boy) 



(Say with child)- 



(Child's name) 

Ask the boy if he always goes 
to this river to fish, 

- -Have you always . . , 



(1) ... gone to this river to fish? 

(5) ... went to this river to fish? 

(6) <20 to this river to fish? 

u) ... goes to this river to fish? 

(8) goad to this river to fish? 

(0) Other 



6. PRONUNCIATION 

Tinitlai consonant sound th_ pronounced as in Whin, think) 

S (Holding thumb up) What do you call this? A ... 



( R ( 1 ) thumb , 

(5) turn, 

(6) fum. 

(7) SJL4ITJ . 
(O) Other 



(/t/ substituted for th) 
(/ f/ substituted for thj 
(/%/ substituted for th) 



7 , 

$ 



PRONUNC IATION 
(Initial consonant cl 

(Point to ground) 
(Point to sky) 



uster /sk/ pronounced) 

We color grass green. 
What do we color blue? 



The 




( 1 ) sky . 

(5) (Jky, 

(6) es-kv 
(o) Other 



(/ s/ omitted from /sk/) 
(vowel added) 





s 
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8. USES OF DO 

(In questions, main verb, likes , changes to like with addition of 
does auxiliary) 



S (Pointing to self) (Child's name) 

Ask me if the boy likes to fish. 



R (1) Does the boy like to fish? 

(5) Do the boy like to fish? 

(6) Does the boy likes to fish? 

(7) Do the boy likes to fish? 

(8) The boy likes to fish? 

(9) The boy Ti ke to fish? 

(0) Other 



( does omitted) 
( does omitted) 



9, PAST PARTICIPLE 

( irregular - pas t participle, made , not the same as infinitive plus 
/t/, i,e,, makt but is the same as irregular past) 



S (Point to the boy) 

. (If necessary, help 
child repeat)- ------- 



Ask the boy if he always makes 
his own fishing pole. 

-Have you always ... 



R (1) ... made your own fishing pole? 

(5) ... make your o wn fishing poie? 

(6) ... makes your own fishing pole? 

(7) ... makt .your own fishing pole? 
(0) Other 



NOTE: Child may confuse pronouns. Do not score his pronoun use. 

Score only the underlined form of past participle. 






SS Use Picture 1 
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10. P RONUNCIATION 

"(Final consonant in the cluster /st/ pronounced) 

S (Make slow swimming motion 
with hand, then make fast 

swimming motion) Soma fish swim very slow, and 

some fish swim very .... 

/ 

R ( 1 ) ... fast. 

(5) ... fas(_), (/t/ omitted from /st/) 

(0) Other 



/ 

i 



\ 



11. PAST TENS E 

(Regular - /t/ ending) 

S (Point to fish) Where did the fish jump? 

(if necessary help 

child repeat)- — The fish ... 

R (1) ... jumped in the river. 

(5) ... jump (_) in the river. (/t/ omitted) 

(6) ... jump-scl in the river. (2 syllables) 

(0) Other 



12. j 5ES~~0F DO 

(j gn 1 1 as auxiliary or as substitute for longer predicate; main verb, 
fttye . remains the same with addition of don't auxiliary; placement of 
not between auxiliary and main verb) 

S (Hoi di>g up pencil or pen) I have a pencil (pen) In my hand. 

Tell me if you have a pencil (pen) 
in your hand. 

(If necesLary, help 

child repeat)- ------ No, I ... 



R (1) ... don ' ( do not) Omve a pencil). 




(5) ... doesn 1 ( does not) (have a pencil). 

(6) ... don't (jo not) has a pencil. 

(?) *** Mi. a pencil, \ ( don't omitted) 

(8) ... have. - a pencil. * . ■ ( don ' t omitted) 

(9) Any answer where not ( no ) Is placed before verb construction; 

, e.g.., "... not (no) hav e a pencil." 

(0) Other ~ 

. 1 '56 Use Picture 1 
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13, PO SSESSIW 

Tegular - js_ pronounced /z/) 

S (Point to father's pole) 



R (1) ... father's (pole). 

(5) ... father's (pole) . 

(6) ... father ! - ) (pole). 

(7) ... pole of the father. 

(0) Other 

NOTE: Dad 1 s s Daddy's and man's may be 



Whose pole is this? This is the .. 



('s_ pronounced /z/) 

('s_ pronounced /%/) 
i/z/ omitted) 
(non-standard possessive) 



substituted for father's. 



14. COMPARISON 
(Superlative) 

S (If necessary, 
child repeat)- 



- -The boy thinks T. V, is fun; 
baseball's more fun, and fishing 
is the ... 



R 



1 ) ... most fun. 

2) ... best . 

(5) ... fun . 

(C) . . . more fun. 

(7) ... funner. 

(8) ... more funner. 

(9) ... funn est . 

(10) ... most funn est . 

(11) Any antonym of fun 
harder , not fun . 

(0) Other 



m 



(positive) 

(comparative) 

(non-standard comparative) 
(non-standard comparative) 
(non-standard superlative) 
(non-standard superlative) 
any form, e.g., hard. 
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15. USE S OF HAVE 

( Has as main verb) 



f 



(Point to father’s 
fishing pole) 

(If necessary, help 
child repeat)- - - 



What does the father have in his hand? 
j*He .... 



R (l) 



has a fishing pole (in his hand). 



.. have a fishing pole (in his hand), 
** haf ■ fishing pole (in his hand). 

,, hab a fishing pole (in his hand). 

,. has a fishing pole (in his hand). 

(0) Other 



(5) 

(6) 
7 



(s. pronounced /s /) 



f 



16. 

S 



PAST TENSE 



ar -/id/ ending) 



(If necessary, help 
child repeat)- - - 



Did the father heed some string, 
or did the boy need some string? 

•The ... . 



R (1) ... (boy* father) needed some string. 

(5) ... (boy, father) nesdet some string, 

(6) ... (boy, father) need(_J some string 

(0) Other . , • , ■ ... 



{/it/ substituted for 
(/id/ ending omitted) 



17. SUBJECT- VERB AGREEMENT 
1/3/ ending on verb) 



(If necessary, help 
child repeat)- - - 



Does the father go home, or 
does he keep on waiting? ,, 

-He ... 



Q 



R (1) ... keeps, on waiting. 

(5) ... keep(_) on waiting. 

(0) Other 

NOTE: If child says, lie goes ho me. 

Then repeat the question. 



(£ pronounced /s/) 

... {/ s/ omitted) 

But . the father’s, still there. 



ERIC 
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Use Picture 1 



18, USES or HAVE 

TUad as main verb) 



14- 



S (Child's name) What did you have 

for lunch yesterday? 

(If necessary s help 

child repeat)- ----------- I, 



R (1) ' . had etc. 

(5) ... have etc, 

(6) . , . has etc, 

(?) , , . hab etc. 

(8) , , , haf etc. 

(9) ... hat etc, 
(0) Other 



19, PLURAL 

(Regular - /s/ ending) 



S (Point to rocks 9 one at 
a time) 



This is a rock. This is a rock* and 
this is another rock. So, there are 
three , , . 



(1) 


, , . rocks^ 


(5) 


... rock(_). 


(6] 


1 


, , , rock-ez. 




1 


... rock-es. 


(el 


1 


... rock-sez, 


(9] 


1 


, , , rock-ses. 


(0] 


1 


Other 



(jL pronounced /$/) 

C/s/ omitted) 

( ez pronounced /5z/) 
( es pronounced / Is/) 
( sez pronounced /slz/) 
( ses pronounced /sis/) 



20. PRONUNCIATION 

(Final consonant sound th_ pronounced as in bath or as in bathe) 

$ Is the boy fishing by himself 1 ^ 

No, he's fishing ... 



R (1) ,,, with his father. 

(/t/ substituted for th) 

(/d/ substituted for thj • 

(/ f/ substituted for th) 

{/%/ substituted for th ) 

59 Use Picture 1 



O 

ERIC 



(5) ... wilt his father. 

(6) ... wiefhis father. 

(7) vrif .his father. 

(8) wis_ his father. 
(0) Other 
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CHANGE TO PICTURE 2 



21 . USES OF DO 

TDossn~*t as auxiliary or as substitute for longer predicate; 
main verb, wears , changes to wear with addition of doesn't 
auxiliary; placement of not between auxiliary and main verb) ? 

S (Point to father's shoes) The father wears shoes in this picture. 

Tell me if the boy wears shoes, 

(If necessary, help 

child repeat)- ---------- -No, he ... 



R (1) ... doesn't ( does not) ( wear shoes). 



(5) ... don't ( do not ) ( wear shoes). 

(6) ... doesn't (does not]'""" wears shoes. 

(7) ... don't ( do not) wears shoes, 

(8) . . , wear shoes. 

(9) ... wears shoes. 

(0) Other 



( doesn't omitted) 
( doesn't omi tted) 




COMPARISON 



S (Point to each fish 

starting with the smallest, 
on the left) 



Here are four fish. This fish is 
short; this one is long. This one 
one is longer; and tin’s fish is the 
very ... 




R (1) ... longest (one). 

(2) ... longest ) (one). 



(5) ... long (one). 

(6) ... longer (one). 

(7) ... more long (one). 

(8) more longer (one). 

(9) ... most long (one). 

(10) .. » most longest (one). 

(11) Any antonym of long , in any form; e.g, 
not long . 

(0) Other 



(positive) 

(comparative) 

(non-standard comparative) 
(non-standard comparati ve) 
(non-standard superlative) 
(non-standard superlative) 
, short , shorter , 






-16- 



23, PLURAL 

(Irregular) 



(Point to boy's feet) 
(1) ,,, feet. 



Here's a foot. And here's a foot. So 
there are two ... 



(5) ... foots . 

(6) .i, fee ts . 

(7) ... foot. 
(0) Other 



NOTE: If a child does not use some form of the word feet , say, 

(showing hands) These are my hands , and (sh- ing feet) 
These are my ... 



24. POSSESSIVE 

(Regular pronounced /lz/) 



S (Point to fish's tail) 



Whose tail is this? This is the 



R (1) ... fish's (tail). ('^pronounced /lz/) 

(5) ... fish's (tail), 

(tail) 

the fish, (non-standard possessive) 



(6) ... fishT3) (tail), {/lz/ ending omitted) 

(7) ... tail of 



(0) Other 



NOTE: Do not score pronunciation problem ? ish. Score only 

the underlined form of the possessive. 



SUBJECT -VERB AGREEMENT 
{/lz/ ending on verb) 



(If necessary, help 
child repeat)- — 



Does the boy use big worms or 
little worms to get the fish? 



-He , 



0) 


... uses 


(big 


(5) 


, ..uses 


(big 


(6) 


. . . usiT 


J. 


(0) 


Other ~ 





( es. pronounced /lz/) 



(esy pronounced /Is/) 
(plural endi rig omitted) 



EMC 
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26, COMPARISON 
(Comparati ve) 

S (Pointing to boy) The boy is little, but the 

(Point to smallest fish) fish is much ... 




R 



( 1 ) . . , 1 i ttler. 

(5) , . , little . 

(6) , . , more 1 ittle. 

(7) ... more li ttler. 

(8) ... lift l est . 

(9) much, 

(10) Any antonym of 1 ittle , 
not little . 

(0) Other 



{ 

(positi ve) 

(non-standard comparative) 
(non-standard comparative) 
(superlative) 

(adjective omitted) 
in any form; e.g, , bl g , bi 



NOTE; Smalle r ( smal 1 , smallest) may be substituted for 1 ittler 
TTi ttl e , i i ttl est) . ; 




27. U SES OF HAVE" 

THave as auxiliary; requires following past participle, fished) 



Ask the boy if he has ever 
fished before. 



R (1) Have .you ever fished before? 



(5) 

( 6 ) 

(7) 

( 8 ) 

(9) 



m; 

( 12 ) 

(13) 

( 0 ) 



Has .you ever fishe d before? 
Has you ever fish (~) before? 
Have you ever fisliT ) before? 
Did you ever fi sh before? 

Did you ever fished before? 

Is you ever f i s h before? 

Is you ever fished before? 

You ever f ish ( ~) before? 

You ever fished before? 

Other 



( have and - ed omitted) 
( have omitted) 




ERJC 



^ . Use Picture 
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( Irregular - past participle, s een , not the same as infinitive plus 
/d/, i.e. 9 seed 9 nor as the past* saw) ‘ 

s Ask the boy if he alv/ays sees a lot 

of fish in the river. 

(If necessary, help 

child repeat) ." Have you a1w ? ys *“ 



R (1) ... s een a lot of fish (in the river)? 

(5) ... saw a lot of fish (in the river)? 

(6) ... see" a lot of fish (in the river)? 

(7) ... sees a lot of fish (in the river}? 

(8) ... seed a lot of fish (in the river)? 

(0) Other 



f 



29 . 



PAST TENSE 

'(Regular - /d/ ending) 



S (Point to boy's mouth) 

(If necessary, help 
child repeat)- ~ - 



Did the boy cry a lot 
or did he smile a lot? 

-He . . . 




. . . smiled (a lot) , 

, . , smil t_ (a lot) . 

. . , smile(__) (a lot) . 
. . . smil-ed (a lot) . 
... smil -et, (a lot) . 
Other 



(/t/ substituted for /cl/ ) 
(/d/ omitted) 

(2 syllables) ' 

(2 syllables) 







> 
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30. DOUBLE N EGATIVE 

(Negated main verb plus affirmative noun determiner or noun substitute: 
a fen t plus any , or (_) birds) 

S (Point to the sky) There are no birds in the sky. 

So we can say that there aren't ... 

R (1) .. . . any . 

(2) ... any birds. 

(3) ... birds. 

i 

(5) ... no bi rds. 

(6) ... none . 

(0) Other 



31. PRON UNCIATION 

(Consonant sound pronounced) 

S (Point to fish) Fish swim with fins. 

What do birds fly with? 





R 



(1) Wings. 

(2) (A) .ving. 

(3) (A) wink( ). 

(4) Wing- ez (- es ) . 




Win., 

Wins. 

Other 



(/n/ substituted for n g) 
(/n/ substituted for ncj) 



NOTE: Child may have difficulty with /z/ pluralization. Do hot 

score pluralization problem. Score only the underlined pronunciation 
problem. 



k!? 1 4n.swe.rs , feathers . ask, (Holding arms out to simulate 
wings) What ar e the feathers on? Or, ask, (Holding arms out) 

What do airplanes fly with? 




ft 



ERIC 



nt : ' 



es 






■ J- . ... 



. . \ «i - -«-v- " 

fviu rf * '■ * 



' , ; v 



Use 7 Pictured 2 




{ 



f 



CHANGE TO PICTURE .3 

32,- TOsr~t£wsE 

( I rregul a r - past, want , not the same as infinitive plus /d/, 
i.e. , goed) 



S 



(If. necessary, help 
child repeat)- - - 



When the father and boy finished 
fishing, where did they go? 

They , , , 



R (1) ... went home. 



(5) ... go home, 

(6) , . , goed home. 

(7) ... go-ed home, 
(0) Other 



(2 syllables) 




33. USES OF 3E 

( Were as "main verb or as substitute for longer predicate) 



S (Point to father and boy) Who was tired? 

(If necessary, help 

child repeat) - -They both ... 



R 0) ... were (tired). 



34, 




R 




.. . was^ (tired). 

• * * i s ( ti red) , 

• • • are (ti red) , 



They. 

Other 



USES OF. BE 
IXs as mai n verb) 

(Point to each object) 



(If necessary, help 
child repeat) 

(1 ) . . . is_ (a table). 



verb omitted) 
verb omitted) 





Let's name some things in this 
>icture. These are dishes., 
lese are chai rs, and 



Ej< 

The 






this 
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35. PLURAL 

(Regul ar - /iz / ending) 



S (Point to glass) 


This is a glass 


(Point to glass) 


This is a glass 




That makes two 


R (1) ... glasses. 


(es pronounced /iz/) 


(5) ... glasses, 

(6) ... glas$T3* 


(es pronounced /Is/) 
(plural ending omitted) 


(0) Other 



35. PRONUNCIATION 

(Initial ch sound pronounced) 

S (Point to chair) What's the mother sitting in? A ... 

R (1) ... chair, 

(5) ... shal r. (sh substituted for ch) 

(0) Other 



37. FO SSESSfvF 

(Regular - ^pronounced /s/) 

S (Point to girl) 

(Point to blouse) 



Let's call the girl Janet. Whose 
blouse is this? This is ... 



R (1) ... Janet's^ (blouse). 

(5) ... Janet (_) (blouse). (/s/ omitted) 

6) .. .the blouse of Janet. (non-standard possessive) 

,o) Other 



38. USES OF BE 



T Tsn 1 t as main verb or as substitute for longer predicate; requires 
following present participle, wearing ; placement of not between 
auxiliary and main verb) 



(Point to father and boy) 
(Point to girl) 

(Shake head "No")- — - - 



The father and boy are wearing shirts 
but 

-the girl ... 



R CD 



isn't ( is not ) (wearing a shirt). 



(5) 

(6) 

(7) 

( 8 ) 
(9) 
( 0 ) 



... aren't ( are not ) (wearing a shirt) 
... ain't (wearing a shirt JT 
... not (no ) " wearing a shirt. 

... doesn't ( does not) ( wear a shirt), 
. . . don't ( do not) ( wear a shi rt) . 
Other 



NOTE; Chi Id may have difficulty with a shirt . Do not score the double 
negative problem, Score only the underlined use of be. 



39, 



USES OF DO 

Tin questions, main verb, baked „ changes to bake with addition 
of did auxiliary) 



S (Point to mother) 



Ask the mother . if she baked a pie? 



R (1) Did you bake a pie? 



( 7 ) 

( 8 ) 

(9) 

n 

( 0 ) 



Do you bake a pie? 
Does you bake a pie? 
Do .you baked a pie? 
Does you baked a pie? 
Did you baked a pie? 
You baked a pie? 

You bake a pie? 

Other 



( did omitted) 
( did omitted) 



NOTE: Child may confuse pronouns. Do not score his pronoun use. 

Score only the underlined. use of do. 



~ f;: 




. -. v v ^ 
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40, COMPARISON 



(Comparati ve) 


a) 


. . . better. 


(2) 


... more. 


(5) 


... best. 


(6) 


... bestest. 


(7) 


• • • flood* 


(8) 


. . , more go< 


(9) 


, . . more be- 


(10) 


much. 


(0) 


Other 



Fish for supper is very good, but the 
boy likes hot dogs much ... 



(superlative) 

(non-standard superlative) 
(positi ve) 

(non-standard comparative) 
(non-standard comparative) 
(adverb omitted) 



M 



> 

k 



41. DOUBLE NEGATIVE 

(Negated main verb plus affirmative noun determiner or noun 
substitutes don't want plus any , more , or any more) 

S (Point to mother) The mother wants to know if the bey 

wants more milk. The boy says, 

"No, I don't want ... \ 



R (1) ... any more (milk)." 

(2) ... more (mil k) . 11 

(3) ... any (milk)." 

(4) ... milk." 



(5) ... no more (milk)," 

(6) ... no milk." 

(7) ... none . " 

(0) Other 








’.V_i “ 












v> r SF.V’j 



' ■ ■ ■ ' 1 ' ' ' ^se Pictu? G 3 . 

.. - - ■ ■ . . - : 



42. 

TNo ending on man n ve rb } 



WfflM 
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r--' 



•? 

X- 



(Point to girl) 

(Point to father and boy) 

(If necessary, help 
child repeat)- -------- 



Look. Everybody is eating fish. 

The girl eats a little bit of fish. 




R (1) ... eat (a lot, a little bit), 

(5) ... eats (a lot, a little bit). 

(0) Other 



43, SUBJECT- VERB AGREEMENT 

(/z/ ending on main verb) 

S Does the boy go outside to play after 

dinner, or does he go to bed? 

(If necessary, help 

child repeat)- ---------- -He ... 



r . (i; 


1 ... goes 


(outside , 


to 


bed) . 


(s^ pronounced / z /) 


(5] 


I ... goes 


(outside. 


to 


bed). 


(£ pronounced /s/) 


(6] 


1 go A outside 5 to bed). 




(7j 


i ... goed 


(outside , 


to 


bed) . 




(8] 


1 ... v/en t 


(outside , 


to 


bed) . 




(0] 


1 Other 





















/ 

MICHIGAN ORAL LANGUAGE PRODUCTIVE TEST - Structured Response 



Response Sheet 



Recording code: 1, 2 S 3* 4 (standard); 5, 6, etc. (non-standard) ; 

0 (other) 

- If child answers with listed 

standard or non-standard response:_ Record response number 

- If child answers with unlisted 





